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Abstract 

We  consider  a  stochastic  model  of  an  ECN/RED  gateway  with 
competing  TCP  sources  sharing  the  capacity.  As  the  number  of  com¬ 
peting  flows  becomes  large,  the  asymptotic  queue  behavior  at  the  gate¬ 
way  can  be  described  by  a  simple  recursion  and  the  throughput  be¬ 
havior  of  individual  TCP  flows  becomes  asymptotically  independent. 

In  addition,  a  Central  Limit  Theorem  complement  is  presented, 
yielding  a  more  accurate  characterization  of  the  asymptotic  queue. 

These  results  suggest  a  scalable  yet  accurate  model  of  the  complex 
large-scale  stochastic  feedback  system,  and  crisply  reveal  the  sources 
of  queue  fluctuations. 
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1  Introduction 

One  of  the  key  mechanisms  for  operating  the  best-effort  service  Internet 
is  the  additive  increase/multiplicative  decrease  (AIMD)  congestion-control 
mechanism  in  the  transmission  control  protocol  (TCP)  [8].  The  AIMD  algo¬ 
rithm  enables  TCP  congestion-control  to  be  robust  under  diverse  conditions. 
Unfortunately,  its  self-clocking  feedback  mechanism  is  highly  nonlinear  and 
induces  complex  behavior  in  network  traffic.  There  has  been  a  number  of 
studies  trying  to  gain  insights  into  this  complex  behavior. 

While  the  relationship  between  the  throughput  of  a  single  TCP  flow  and 
its  round-trip  and  loss  probability  is  fairly  well  understood  [1,  12,  13,  15], 
these  models  are  not  suitable  for  the  analysis  of  many  TCP  flows  competing 
for  the  bandwidth  of  a  link.  Typically,  with  each  TCP  flow  modeled  in  great 
details,  the  size  of  the  state  space  for  the  model  explodes  when  the  number 
of  flows  becomes  large,  and  the  analysis  then  becomes  intractable.  Even  nu¬ 
merical  calculations  or  simulations  of  such  models  are  very  complicated  and 
become  computationally  prohibitive,  thereby  providing  no  additional  advan¬ 
tages  over  full-scale  (system)  simulation  with  existing  simulation  packages 
(e.g.,  NS  [14]).  To  be  sure,  certain  simplifying  assumptions  could  be  made, 
but  it  is  not  clear  from  the  onset  which  details  can  be  omitted  without  re¬ 
ducing  the  predictive  power  of  the  model. 

To  make  matters  worse,  recent  developments  in  Active  Queue  Manage¬ 
ment  (AQM)  techniques  have  introduced  additional  complexity  in  transport 
protocols.  The  development  of  AQM  was  prompted  by  the  observation  that 
with  simple  Tail-Drop  gateways,  TCP  congestion-control  leads  to  undesirable 
behavior,  i.e.,  global  synchronization  [21],  When  several  TCP  flows  compete 
for  bandwidth  in  a  Tail-Drop  gateway,  it  has  been  observed  experimentally 
that  packets  from  many  flows  are  usually  discarded  simultaneously,  resulting 
in  a  poor  utilization  of  the  network.  AQM  mechanisms  such  as  Random 
Early  Detection  (RED)  [6]  and  Explicit  Congestion  Notification  (ECN)  [5] 
have  been  proposed  to  help  alleviate  this  problem  by  randomly  marking 
packets  with  probability  depending  on  queue  size.  TCP,  in  turn,  triggers 
its  multiplicative  decrease  mechanism  upon  receiving  marked  packets.  This 
allows  each  TCP  flow  to  react  early  to  the  growing  congestion,  thereby  avoid- 
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ing  heavy  congestion  and  preventing  global  synchronization.  As  can  easily 
be  imagined,  the  introduction  of  AQM  further  exacerbates  the  difficulty  of 
understanding  issues  associated  with  buffer  behavior  and  aggregate  TCP 
traffic. 

The  interaction  between  TCP  and  AQM  mechanisms  are  typically  inves¬ 
tigated  in  the  framework  of  utility  maximization  problems  [10,  11].  While 
there  are  many  advantages  of  viewing  the  system  as  a  utility  maximization 
problem  and  of  modeling  TCP  traffic  as  distributed  algorithms  for  solving  it, 
there  are  definite  drawbacks  as  well  to  this  approach.  The  most  glaring  is  the 
absence  of  the  probabilistic  nature  of  AQM  mechanisms  in  the  model  -  the 
signaling  mechanisms  from  AQM  to  TCP  flows  are  usually  modeled  as  feed¬ 
back  gains  or  penalty  functions  in  this  framework.  Additionally,  while  the 
solution  to  the  maximization  problem  might  accurately  describe  the  steady- 
state  solution  of  TCP,  the  distributed  solution  does  not  necessarily  capture 
the  short-term  dynamics  of  TCP  well  cine  to  the  absence  of  the  packet-level 
window  mechanism  of  TCP.  The  transient  behavior  of  the  network  traffic  is 
much  more  crucial  in  the  actual  system  due  to  the  highly  heterogeneous  and 
time- varying  nature  of  Internet. 

Recently,  there  has  been  a  growing  interest  in  macroscale  modeling  of 
TCP  flows,  as  opposed  to  microscale  models  where  each  TCP  flow  is  mod¬ 
eled  in  detail.  Macroscale  TCP  models  can  be  developed  by  systematically 
applying  limit  theorems  to  derive  a  limiting  traffic  model  when  the  number 
of  TCP  flows  is  large.  The  potential  benefits  of  doing  so  are  three-fold.  First, 
model  simplification  (with  the  promise  of  scalability)  typically  occurs  when 
applying  limit  theorems,  with  irrelevant  details  filtered  out  without  relying 
on  ad-hoc  assumptions.  Second,  limit  theorems  are  central  to  the  modern 
Theory  of  Probability,  and  as  such  have  been  the  focus  of  a  huge  literature 
that  contains  a  large  number  of  results  and  techniques.  Given  this  large  body 
of  knowledge,  it  is  reasonable  to  expect  the  existence  of  suitable  limit  theo¬ 
rems  (under  very  weak  assumptions)  which  can  be  applied  to  the  situation 
of  interest.  Finally,  in  the  networking  context,  resource  allocation  problems 
are  most  pressing  in  networks  operating  at  high  utilization,  e.g.,  when  the 
number  of  users  is  large  in  relation  to  available  resources.  In  such  a  scenario, 
the  limiting  model  will  become  increasingly  more  accurate  as  the  number  of 
users  increases. 

Limit  theorems  for  a  bottleneck  queue  under  a  large  number  of  rate- 
controlled  TCP-like  flows  have  been  recently  considered  by  a  number  of  au¬ 
thors  [2,  7,  16];  a  survey  of  the  relevant  literature  can  be  found  in  [18]. 
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While  these  models  already  suggest  some  of  the  preliminary  results  to  be 
expected  from  aggregating  a  large  number  of  TCP  flows,  they  all  lack  the 
notion  of  “packets”  and  the  explicit  window  mechanism  of  TCP  congestion- 
control  which  relies  on  packet-level  operations.  Further,  they  only  consider 
the  mean  asymptotic  queue  size  which  lacks  the  finer  description  of  the  queue 
distribution  necessary  for  network  dimensioning.  In  this  paper,  we  incorpo¬ 
rate  the  TCP  window  mechanism  explicitly  to  model  the  ECN-capablc  TCP 
congestion-control  mechanism  competing  for  bandwidth  in  a  RED  gateway. 
Our  model  uses  RED  as  the  AQM  mechanism  because  it  is  the  simplest 
and  most  widely-deployed  AQM  mechanism.  However,  the  analytical  results 
in  this  paper  can  be  generalized  to  a  large  class  of  generic  window-based 
congestion-control  mechanisms  and  probabilistic  AQM  schemes,  e.g.,  see  the 
recent  extensions  in  [17]. 

We  establish  several  asymptotics  when  the  number  of  flows  is  large, 
namely  a  Law  of  Large  Numbers  (LLNs)  for  the  aggregate  traffic  into  the 
RED  buffer  and  a  basic  limit  theorem  for  the  normalized  queue  size  [Section 
3].  We  sharpen  these  results  with  a  Central  Limit  Theorem  (CLT)  comple¬ 
ment  [Section  4],  These  results  were  announced  mostly  without  proofs  in 
the  conference  paper  [19].  They  crisply  reveal  the  relationship  between  RED 
buffers  and  the  probabilistic  marking  mechanism  in  RED.  The  CLT  result 
presented  here  is  the  first  of  its  kind  in  the  literature  on  TCP/AQM  mod¬ 
eling  and  can  assist  in  the  network  dimensioning  problem  by  establishing  a 
probability  distribution  on  the  buffer  utilization  in  RED  gateways. 

The  paper  is  organized  as  follows.  In  Section  2  the  model  is  described  in 
detail,  and  a  first  set  of  asymptotic  results  are  presented  in  Section  3,  and 
Section  4  contains  the  Central  Limit  Theorem  complement.  A  discussion 
of  the  results  is  given  in  Section  5.  The  analysis  starts  with  some  useful 
facts  in  Section  6.  This  is  followed  by  an  outline  of  the  proofs  of  the  the 
LLNs  and  CLT  in  Sections  7  and  8,  respectively.  The  details  of  the  proof  of 
the  LLNs  are  provided  in  Appendix  A.  The  proof  of  the  CLT  complement 
is  more  elaborate  and  occupies  the  remainder  of  the  paper;  it  is  presented 
throughout  Sections  9-14.  Additional  technical  details  have  been  relegated 
to  Appendices  B  and  C. 

A  word  on  the  notation  in  use:  Vectors  are  understood  as  row  vectors. 
Equivalence  in  law  or  in  distribution  between  random  variables  (rvs)  is  de¬ 
noted  by  =st.  The  indicator  function  of  an  event  A  is  simply  1  [A],  and  we 

p 

use  — (resp.  =^n)  to  denote  convergence  in  probability  (resp.  weak 
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convergence  or  convergence  in  distribution)  with  n  going  to  infinity.  For  any 
scalar  x,  we  use  the  notation  (x)+  to  represent  max(x,0). 

2  A  discrete-time  model 

2.1  A  brief  review  of  TCP  +  ECN/RED  dynamics 

We  focus  on  a  given  flow  transiting  through  a  (bottleneck)  node  and  on  the 
size  of  its  congestion  window,  i.e.,  the  amount  of  unacknowledged  packets 
in  the  network  per  round-trip.  This  size  is  dynamically  adjusted  by  the 
following  TCP  congestion- control  algorithm  [8]:  In  a  round-trip,  if  all  the 
packets  transmitted  are  not  marked,  then  the  size  of  the  congestion  window 
is  increased  by  one  packet  for  the  next  round-trip.  On  the  other  hand,  if  at 
least  one  packet  is  marked  in  the  round-trip,  the  congestion  window  is  halved. 
The  probability  that  the  router  will  mark  packets  in  the  buffer  depends  on  the 
average  queue  length  at  the  time  of  packet  arrival.  The  average  queue  length 
is  calculated  by  an  exponential  average  filter  with  large  memory  to  prevent 
RED  from  reacting  too  fast.  As  a  result,  consecutive  incoming  packets  into 
RED  are  marked  with  almost  identical  probability.  With  this  in  mind,  we 
now  construct  a  model  whose  dynamics  are  similar  in  spirit  to  the  dynamics 
of  TCP  +  ECN/RED. 

2.2  The  discrete-time  model 

Time  is  assumed  discrete  and  slotted  in  contiguous  timeslots  of  duration  equal 
to  the  round-trip  delay  of  TCP  connections.  We  consider  N  traffic  sources,  all 
transmitting  through  a  bottleneck  RED  gateway  with  ECN  enabled  in  both 
TCP  and  RED.  The  bottleneck  RED  gateway  has  capacity  NC  packets/slot 
for  some  positive  constant  C.  The  RED  buffer  is  modeled  as  an  infinite 
queue,  so  that  no  packet  losses  occur  due  to  buffer  overflow,  and  congestion- 
control  is  achieved  solely  through  the  random  marking  algorithm  in  the  RED 
gateway. 

Fix  N  —  1,  2, . . .  and  t  —  0, 1, . . ..  We  write  to  indicate  the  explicit 
dependence  of  the  quantity  X  on  the  number  N  of  connections. 
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2.3  Dynamics 

Suppose  that  each  of  the  N  TCP  sources  has  an  infinite  amount  of  data  to 
transmit  and  that  in  each  timeslot  it  transmits  as  much  as  allowed  by  its 
congestion  window  in  that  timeslot.  So,  for  i  —  1, . . . ,  N,  let  w[N\t)  be  an 
integer-valued  rv  that  encodes  the  number  of  packets  generated  by  source  i 
(and  hence  its  congestion  window)  at  the  beginning  of  the  timeslot  [t,t  +  1). 
The  integer  W^N\t)  is  assumed  to  be  in  the  range  {1, . . . ,  Wma.x }  for  some 
finite  integer  Wm ax,  i.e., 

W%{N\t)e{l,...,Wmax}  (l) 

with  Wmax  >  2  to  avoid  trivial  and  uninteresting  situations. 

Given  that  N  sources  are  active,  the  total  number  of  packets  which  are 
accepted  into  the  RED  buffer  at  the  beginning  of  timeslot  [t,  t  +  1)  is  given 
by 

N 

A(N>(t)  =  £w,m(t).  (2) 

i= 1 

If  Q(N)(t)  denotes  the  number  of  packets  in  the  buffer  at  the  beginning  of 
the  timeslot  [t,t  +  1),  then  Q^N\t)  +  A^(t)  packets  are  available  for  trans¬ 
mission  in  that  timeslot.  Since  the  outgoing  link  operates  at  the  rate  of  NC 
packets/timeslot,  (Q^N\t)  +  A^N\t)  —  NC)+  packets  will  not  be  transmit¬ 
ted  during  timeslot  [t,t  +  1],  and  remain  in  the  buffer,  their  transmission 
being  deferred  to  subsequent  timeslots.  The  number  Q(N\t  +  1)  of  packets 
in  the  buffer  at  the  beginning  of  the  timeslot  [t  +  1,  t  +  2)  is  then  given  by 

Q{n)  (t  +  1)  =  (Q(iV)  (t)  —  NC  +  AW  (t))+.  (3) 

Upon  arrival  at  the  RED  gateway,  each  packet  from  source  i  may  be 
marked  according  to  a  random  marking  algorithm  (to  be  specified  shortly). 
We  represent  this  possibility  by  the  {0,  l}-valued  rv  M-j\t  +  1)  (with  j  = 

1, ...,  W,j;N\t))  with  the  interpretation  that  M-j\t  +  1)  =  0  (resp.  M-J\t  + 
1)  =  1)  if  the  jth  packet  from  source  i  is  marked  (resp.  not  marked)  in  the 
RED  buffer.  Next  we  introduce  the  rvs 

wfN)(t) 

1)=  n  uw+i)  <4) 

3=1 
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so  that  M-N\t  +  1)  =  1  (resp.  M-N\t  +  1)  =  0)  corresponds  to  the  event 
that  no  packet  (resp.  at  least  one  packet)  from  source  i  has  been  marked  in 
timeslot  [t,t  +  1).  The  evolution  of  the  window  mechanism  for  source  i  can 
now  be  described  through  the  recursion 

Wl{N\t  + 1)  =  mm(w^N\t)  +  l,WmJ)M^\t+l) 

+  min  ^  ,  Wma}j  (1  -  Mf }  (t  +  1)).  (5) 

This  equation  emulates  the  interaction  between  TCP  and  RED  as  follows:  If 
no  packet  from  source  i  is  marked  in  the  timeslot  [t,  t+ 1),  then  the  congestion 
window  size  in  the  next  timeslot  is  increased  by  one  packet.  On  the  other 
hand,  if  one  or  more  packets  are  marked  in  the  timeslot  [t,t  +  1),  then  the 
congestion  window  in  the  next  timeslot  is  reduced  by  half.  The  size  of  the 
congestion  window  is  limited  by  the  maximum  window  size  Wmax  1 . 


2.4  Statistical  assumptions 

In  order  to  fully  specify  the  model,  we  need  to  specify  the  joint  statistics  of 
the  rvs 


{M^(t  +  l),M^(t),  i  =  l,...,N-  J  =  1,2,...;  f  =  0,1,...}. 

To  do  so  we  introduce  the  collection  of  i.i.d.  [0, 1  }-uniform  rvs  {I j(t  + 
1),  +  1),  i,j  =  1,  • •  • ;  t  =  0,1,...}  2  which  are  assumed  independent 

of  the  rvs  Q(iV)(0)  and  kE^^O), . . . ,  kP^(O).  We  also  introduce  a  mapping 
:  R+  — >  [0, 1]  which  acts  as  the  marking  probability  function  of  the  RED 
gateway. 

The  process  by  which  packets  are  marked  is  described  first:  For  each 
i  —  1, . . . ,  N,  we  define  the  marking  rvs 

M$)(t  + 1)  =  l[Vi}j(t  +  l)>  fW(Q(N\t))},  j  =  1,2,...  (6) 


so  that  the  rv  M^\t  +  1)  is  the  indicator  function  of  the  event  that  the 
jth  packet  from  source  i  is  not  marked  in  the  timeslot  [t,t  +  1).  Thus,  in 

1If  W(JV)(0)  lies  in  the  range  {1, . . . ,  Hmax}  for  each  i  =  1, ...  ,1V,  then  so  does  W^N\t) 
for  each  t  =  0, 1, , . .  and  the  minimum  with  WmSLX  in  the  second  term  of  (5)  can  be  omitted. 

2The  need  for  the  sequence  {E(t  +  1),  i  =  1, . . . ;  t  =  0, 1, . . .}  will  become  apparent 
at  a  later  stage  in  the  discussion. 
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a  round-trip,  each  packet  coming  into  the  router  is  marked  with  identical 
(conditional)  probability  which  depends  only  on  the  queue  length  at  the 
beginning  of  the  timeslot.  This  model  approximates  the  case  where  the 
memory  of  the  queue  averaging  mechanism  is  long,  which  is  the  case  for  the 
recommended  parameter  settings  of  RED  [6] . 

3  Asymptotics  via  the  Law  of  Large  Numbers 

The  first  result  of  the  paper  consists  in  the  asymptotics  for  the  normalized 
buffer  content  as  the  number  N  of  sources  becomes  large.  This  result,  con¬ 
tained  in  Theorem  3.1  below,  is  discussed  under  the  following  assumptions 
(A1)-(A2): 

(Al)  There  exists  a  continuous  function  /  :  1R+  — >  [0, 1]  such  that  for  each 
N=  1,2,.., 

fiN\x)  =  f(N^x),  x  >  0; 

(A2)  For  each  N  =  1,2, . . .,  the  dynamics  (3)  and  (5)  start  with  the  condi¬ 
tions 

Q{n)  (0)  =  0  and  Wt(N\  0)  =  W,  i  =  l,...,N 
for  some  integer  W  in  the  range  {1, . . . ,  Wmax}. 

Assumption  (Al)  is  a  structural  condition.  Since  we  are  interested  in  a 
“snapshot”  of  the  dynamics  when  N  flows  exists  in  the  system,  then  /  is  just 
a  surrogate  function  representing  the  average  contribution  that  each  flow  has 
on  the  marking  probability.  Meanwhile,  Assumption  (A2)  is  made  essentially 
for  technical  convenience  as  it  implies  that  for  each  N  =  1,2,...  and  all 
t  —  0, 1, . . .,  the  rvs  W[N\t), . . . ,  W^\t)  are  exchangeable.  This  assumption 
can  be  omitted  but  at  the  expense  of  a  more  cumbersome  discussion. 

Theorem  3.1.  Assume  (Al )-(A2)  to  hold.  Then,  for  each  t  —  0, 1, . . .,  there 
exist  a  (non-random)  constant  q(t )  and  an  {1, ...  ,Wmax} -valued  rv  W(t ) 
such  that  the  following  holds: 

(i )  The  convergence  results 

»  ^  *(*)  and  w[N\t)^NW(t)  (7) 

take  place; 
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( ii )  For  any  function  g  :  IN  — >  R, 


^  —a  E  [sWf))] ,  (8) 

1=1 

(in)  For  any  integer  I  =  1,2,...,  the  rvs  {W^N\t),  i  =  1 become 
asymptotically  independent  as  N  becomes  large,  with 

i 

lim  P  \wt{N\t )  =ki}  i  =  l, . ,/l  =TTP  [W(t)  =  ki\  (9) 

N^oo  L  J  -a--a- 

i=  1 

for  any  k\ ,  . . . ,  kj  in  N 

Moreover,  with  initial  conditions  q( 0)  =  0  and  W{ 0)  =  W ,  it  holds  that 

q(t+l)  =  (q(t)-C+E[W(t)})+  (10) 


W{t  + 1)  =*  mm(W(t)  +  l,Wmax)M(t  +  l) 

+  min^^l  ,WmJj  (1  —  M(t  +  1))  (11) 

where 

M(t  +  1)  =  1  [V(t  +  1)  <  (1  -  f(qmW{t)]  (12) 

for  i.i.d.  [0, 1  }-uniform  rvs  {V (t  +  1),  t  =  0, 1, . . 

A  proof  of  Theorem  3.1  is  given  in  Section  7.  As  will  become  apparent 
from  the  discussion  given  there,  Theorem  3.1  readily  flows  from  a  Weak  Law 
of  Large  Numbers  [Claim  (ii)]  for  the  triangular  array 

{Wt{N\t),  i  =  1, . . . ,  N]  N  =  1,2, . . 


We  close  this  section  with  a  simple  but  useful  consequence  of  Claim  (i) 
of  Theorem  3.1,  namely  that 


~~*n  f(q(t)) 


(13) 


under  the  continuity  assumption  on  /. 
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4  A  Central  Limit  complement 

In  this  section,  we  present  a  Central  Limit  Theorem  (CLT)  which  comple¬ 
ments  the  limiting  results  obtained  earlier.  The  discussion  is  carried  out 
under  the  same  setup  as  in  Section  3,  but  with  Assumption  (Al)  strength¬ 
ened  to  read  as  Assumption  (Alb),  where 

(Alb)  Assumption  (Al)  holds  with  mapping  /  :  R+  — »  [0, 1]  which  is  con¬ 
tinuously  differentiable,  i.e.,  its  derivative  f  :  R+  — >  R  exists  and  is 
continuous. 


Fix  t  —  0, 1, . . ..  With  the  notation  of  Theorem  3.1,  define 


K(t)  :=  C  -  q(t)  -  B  \W(t)] .  (14) 


We  can  interpret  K(t )  as  the  asymptotic  residual  capacity  per  user  in  the 
timeslot  [t,  t  +  1).  Moreover,  for  each  N  —  1, . . .,  set 


Ll>) 


(15) 


and 

1  N 

(W<N)^  - E  i^wi)  ■  (16> 

i= 1 

The  result  will  be  given  a  more  compact  form  by  using  the  mapping 
$  :  R2  — >  R  given  by 


(0  if  K  >  0 
$(/!, x)  :=  <  x+  if  K  =  0 
\  x  if  K  <  0 


(17) 


for  arbitrary  x  in  R. 

Theorem  4.1.  Assume  (Alb)-(A2)  to  hold.  Then,  for  each  t  =  0,1,..., 
there  exists  an  R2- valued  rv  (L0(t),  Lavg(t))  such  that  the  convergence 

Vn  (Lo(i),W0)  (18) 

holds.  Moreover,  the  distributional  recurrence 

L0(t  +  1)  —st  ( t ),  Lo(t)  +  Lavg(t))  (19) 


holds. 
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(20) 


The  convergence  (18)  suggests  the  distributional  approximation 

Q{N)(t)  ~st  Nq(t )  +  VNL0(t) 

and 

N 

W^N\t)  ~st  NE  [W (£)]  +  VNLavg(t)  (21) 

i= 1 

for  large  N.  Given  the  interpretation  of  K(t)  as  the  asymptotic  residual 
capacity  per  user  in  timeslot  [t,t  +  1),  if  there  exists  extra  capacity  for  the 
average  user  rate  to  increase  (K(t)  >  0),  then  there  is  no  fluctuation  in 
the  limiting  queue.  On  the  other  hand,  when  there  is  congestion  ( K(t )  < 
0),  the  fluctuation  has  a  (non-trivial)  limiting  distribution  which  can  be 
characterized.  Some  technical  difficulties  arise  in  the  special  case  K(t)  =  0. 

The  proof  of  Theorem  4.1  is  given  at  the  end  of  Section  8,  and  relies  on 
showing  that  some  key  convergence  statements  propagate  over  time.  In  the 
process  we  prove  a  lot  more.  In  particular,  if  we  specialize  (40),  one  of  the 
by-product  of  this  analysis,  to  the  mapping  g  :  IN  — >  1R  given  by  g(w)  =  w, 
we  find  that  Tavg(f  +  1)  is  of  the  form 

W*  +  1)  =*  S(i)  -  f'{q{t))R{t)L0{t)  +  Y{t  +  1)  (22) 

where  R(t)  is  a  constant,  Y(t+  1)  is  a  zero-mean  Gaussian  rv  independent  of 
the  pair  of  rvs  (L0(f),  5(f))  and  the  statistics  of  the  rv  S(f)  are  determined 
by  q(0),  g(l), . . . ,  q(t  —  1).  The  variance  of  Y(t  +  1)  is  given  in  (41)  (with 
g(x)  =  x)  and  it  follows  from  (64)  (with  h(w)  =  w)  that 

5  Discussion 

Theorems  3.1  and  4.1  show  that  the  dynamics  of  the  queue  at  time  t  can 
be  approximated  by  the  recursion  (20),  where  both  q(t)  and  Lo(t)  can  be 
evaluated  independently  of  the  number  of  users.  The  approximation  becomes 
more  accurate  as  the  number  of  users  becomes  large.  This  limiting  model  is 
“scalable”  in  that  it  does  not  suffer  from  state  space  explosion,  nor  does  it 
require  any  ad-hoc  assumptions  in  the  analysis. 

Claim  (iii)  of  Theorem  3.1  also  states  that  the  dependency  at  each  timeslot 
between  the  window  size  of  each  TCP  connection  becomes  negligible  under 
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a  large  number  of  flows.  This  claim  is  in  line  with  the  commonly  held  belief 
and  simulation  results  suggesting  that  “RED  breaks  global  synchronization” 
[6]- 

A  closer  inspection  into  the  distributional  relation  (22)  reveals  that  the 
fluctuation  Lavg(t  +  1)  in  the  input  traffic  during  timeslot  [t  +  l,f  +  2)3  is 
composed  of  the  following  three  distinct  components: 

(i)  The  term  —f'(q(t))R(t)L0(t)  represents  the  fluctuations  caused  by  the 
discrepancy  between  the  feedback  information  from  RED  to  TCP  sources 
/(iV)  (QkD(f))  and  the  limiting  feedback  information  f(q(t)).  This  uncer¬ 
tainty  in  feedback  information  manifests  itself  as  —f'(q(t))R(t)L0(t)  and  can 
be  explained  by  the  well-known  Delta  Method  [Section  12],  As  the  slope 
of  the  feedback  function  increases,  the  magnitude  of  fluctuation  due  to  this 
component  increases  as  well.  This  supports  the  observation  that  the  magni¬ 
tude  of  queue  size  oscillation  at  RED  gateways  increases  with  the  slope  of 
the  marking  probability  function  of  RED  mechanism  [4] ; 

(ii)  The  term  Y(t+ 1)  represents  the  fluctuations  caused  by  the  difference 
between  the  (conditional)  Bernoulli  rvs  representing  feedback  information 
available  at  the  sources,  i.e.,  the  rvs  M-N\t  +  l),i  =  1,2, ...  ,N,  and  the 
desired  feedback  information  (f^N\Q^N\t)))  at  RED.  Recall  that  a  TCP 
source  can  only  react  to  whether  the  RED  gateway  marks  a  packet  from  this 
source  or  not  in  the  previous  round-trip.  This  binary  nature  of  the  feed¬ 
back  information  imposes  a  limited  feedback  information  granularity,  and 
induces  fluctuations  in  the  input  traffic.  These  fluctuations  cannot  be  cap¬ 
tured  without  taking  into  account  the  detailed  packet-level  operations  of  the 
congestion-control  mechanism. 

(iii)  The  term  5(f)  represents  the  fluctuations  in  the  previous  timeslots, 
i.e.,  from  timeslot  [0,1)  upto  [f  —  l,f),  being  propagated  over  to  timeslot 
[t  +  1,  t  +  2). 

Both  the  Monte-Carlo  simulations  of  the  model  and  the  NS-2  simulations 
in  [19]  suggest  that  the  limiting  behavior  of  the  queue  follows  the  results  in 
Theorem  3.1.  Furthermore,  the  standard  deviation  of  the  normalized  queue 
size  at  steady-state  decreases  with  a  rate  which  appears  to  be  consistent  with 
the  prediction  of  the  Central  Limit  Theorem,  i.e.,  the  standard  deviation 
decreases  with  a  rate 

3From  (19)  we  recall  that  Lavg(f  + 1)  will  be  compounded  into  L0(t+  2)  if  K(t+ 1)  <  0, 
i.e.,  the  fluctuations  in  the  input  traffic  will  cause  the  queue  to  fluctuate  in  the  next 
timeslot. 
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6  Some  useful  relations 

To  facilitate  the  presentation  of  the  proof  of  Theorem  3.1,  we  begin  with 
several  simple  yet  helpful  facts.  Throughout  the  discussion,  for  each  t  = 
0, 1, . . .,  we  shall  find  it  useful  to  write 

Z(t)  :=  (1  -  f(q(t)))W[,)  =  7 (t)wm  (23) 

with 

7(f)  :=  1  -  /(?(*))■  (24) 

Consider  an  arbitrary  mapping  g  :  IN  — >  1RP  for  some  positive  integer  p  : 
With  g  we  associate  the  bounded  mappings  g*,g*  :  IN  — »  Rp  given  by 


g*(w)  :=  r/ (ruin 

(w  +  1,  Wmax)),  W  G  IN 

(25) 

and 

(r|l,^max)),  WeN. 

9*{w)  ■=  S' (min 

(26) 

Fix  i  —  1, . . . ,  N  and  t  —  0, 1, . 

...  It  follows  from  (5)  that 

g(W,m(t+l)) 

(27) 

=  Mf  >(i  +  l)<f  (wf°(())  +  (1  -  Mf  \t  +  l))g,(W^ '(«))• 

If  Tt  denotes  the  cr-field  generated  by  the  rvs 

{QW(0),Wl(Af)(0),b(S),by(S),  =  1,2, ;  5  =  1, 

then  the  rvs  Q^N\t)  and  W^N\t)  ( i  =  1,  are  all  jCrmeasurable. 

Hence,  under  the  enforced  independence  assumptions,  it  holds  that 

E  [M%\t  +  1)| =  1  -  f{N\Q{N\t)),  j  =  1,  2, . . . 

so  that 

E  [llff0  (t  +  1)  =  Z\N)  (t)  (28) 

by  conditional  independence,  where  we  have  set 

zf  >(t)  :=  (1  -  =  7OT(t)»'.<",(‘)  (29) 

with 

7^(1)  :=1-/W(QW(t)).  (30) 
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It  readily  follows  from  (27)  that 

E  [g(WlN\t  +  1))|^,]  =  Z[N\t)g'(wlN\t))  +  (1  -  zf- '(t))g.(W,m(t)) 

=  Fg(zlN\t),W,m(t))  (31) 

where  the  mapping  Fg  :  [0, 1]  x  IN  — >  1R  is  associated  with  g  through 

Fg(z,  w)  =  zg*(w)  +  (1  -  z)g*(w),  z  G  [0, 1],  w  e  IN.  (32) 

Upon  taking  expectations  on  both  sides  of  (31),  we  finally  obtain 

E  [S(Hf(l  +  1))]  =  E  [Fg(zf] \t),  wf  >(«))]  •  (33) 

7  A  proof  of  Theorem  3.1  (Outline) 

For  each  t  —  0, 1, . . the  statements  [A:t],  [B:t],  [C:t]  and  [D:t]  below  refer 
to  the  following  convergence  statements: 

[A:t]  For  some  non-random  q(t),  it  holds  that 

~~*n  g(t);  (34) 

[B:t]  For  some  {1, . . . ,  IUmax}-valued  rv  W  (t),  it  holds  that 

w}N)(t)  =>NW(t);  (35) 

[C:t]  For  any  integer  /  =  1,  2, . . the  rvs  {Wj;N\t),  i  =  1 become 
asymptotically  independent  with  large  N  as  described  by  (9)  and  the 
rv  W(t)  is  the  one  occurring  in  [B:t]; 

[D:t]  For  any  mapping  g  :  1R  — >  1R,  the  convergence  (8)  holds  with  the  rv 
W {t )  occurring  in  [B:t], 

Through  a  series  of  lemmas,  we  shall  prove  the  validity  of  the  statements 
[A:t]-[D:t]  for  all  t  —  0, 1, .  . ..  We  do  so  by  induction  on  t  and  in  the  process 
we  establish  Theorem  3.1. 

Lemma  7.1.  Under  (Al),  if  [A:t]  and  [B:t]  hold  for  some  7  =  0,1,...,  then 
[B:t+1]  holds  with  W(t  +  1)  related  to  W{t )  by  (11). 
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Lemma  7.2.  Under  (A1 ),  if  [A:t]  and  [D:t]  hold  for  some  t  =  0, 1, . . then 
[A:t+1]  also  holds. 

Lemma  7.3.  Under  (Al)-(A2),  if  [A:t],  [B:t]  and  [C:t]  hold  for  some  t  = 
0, 1, . . .,  then  [C:t+1]  also  holds. 

Lemma  7.4.  Under  (Al)-(A2),  if  [A:t],  [B:t]  and  [C:t]  hold  for  some  t  = 
0, 1, . . .,  then  [D:t]  holds. 

Lemmas  7. 1-7.4  are  proved  in  Appendix  A.  We  now  conclude  with  a 
proof  of  Theorem  1:  Under  (Al)-(A2)  the  statements  [A:t]-[D:t]  trivially 
hold  for  t  —  0  with  g(0)  =  0  and  W{ 0)  =  W.  Moreover,  if  [A:t]-[C:t] 
hold  for  some  t  =  0, 1, . . then  so  do  the  statements  [A:t+l]-[C:t+l]  by 
Lemmas  7.1,  7.2  and  7.3.  Finally,  both  statements  [D:t]  and  [D:t+1]  hold 
by  virtue  of  Lemma  7.4.  Consequently,  the  statements  [A:t]-[D:t]  do  hold 
for  all  t  —  0, 1, ...  by  induction,  and  the  validity  of  Claims  (i)-(iii)  of  Theorem 
3.1  is  established.  The  proof  of  Lemma  7.2  also  shows  (10),  while  (11)-(12) 
are  already  contained  in  Lemma  7.1. 

We  close  with  a  result  that  builds  on,  and  strengthens,  Claim  (ii)  of 
Theorem  3.1.  This  result  will  be  used  in  proving  Theorem  4.1  later  on,  and 
its  proof  is  available  in  Appendix  B. 

Proposition  7.5.  Assume  (A1)-(A2)  to  hold.  Then,  for  each  t  =  0, 1, . . ., 
and  any  function  g  :  IN  — >  1R,  it  holds  that 

1  N 

4X>W<'°(<))Zi<'°(i)'  —  n  E  [g(W(t))Z(t)']  (36) 

i= 1 

for  each  integer  l  =  1,  2, . . .. 

8  A  proof  of  Theorem  4.1  (Outline) 

As  in  the  proof  of  Theorem  3.1,  we  proceed  by  induction  on  t  with  the  help  of 
a  series  of  technical  facts.  Again  the  discussion  is  facilitated  by  introducing  a 
number  of  auxiliary  convergence  statements  to  be  propagated  in  time.  With 
the  aim  to  simplify  the  presentation,  for  arbitrary  mapping  g  :  IN  — >  1RP  with 
positive  integer  p,  we  define 

N  \ 

£s(»f(!))-E[9(»-(t))]  ,  W  =  1,2,... 

,i= 1  / 


Lf\t) 
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for  each  t  —  0, 1, . . ..  The  rv  L^g  (t)  corresponds  to  the  choice  g(w)  =  w. 

For  each  t  —  0, 1, . . we  introduce  the  auxiliary  convergence  statements 
[E:t]  and  [Fit],  where 

[E :  t]  For  arbitrary  mapping  g  :  IN  — »  Rp  with  positive  integer  p,  there  exists 
an  Rp+ 1  -valued  rv  (L0(t),  Lg(t))  such  that  the  joint  convergence 

VN  =*.„(!„(«),  !„(«))  (37) 


takes  place; 

[Fit]  For  arbitrary  mapping  g  :  IN  — >  Rp  with  positive  integer  p,  there  exists 
an  Rp+ 1  -valued  rv  (L0(t  +  1),  Lg(t ))  such  that  the  joint  convergence 

=^jv  (Lo(t  +  1),  Lg(t))  (38) 

takes  place,  with 

(L0(t  +  1),  Lg(t))  —st  (<£>  (A  (t),  L0(t )  +  Lavg(t)) ,  Lg(t ))  (39) 

with  mapping  <f>  defined  at  (17). 

These  convergence  statements  propagate  in  time  as  the  discussion  now 
shows: 

Proposition  8.1.  Under  (Alb)-(A2),  if  [E:t]  holds  for  some  t  =  0, 1, . . 
then  [Fit]  holds. 

Proposition  8.2.  Under  (Alb)-(A2),  if  [E:t]  holds  for  some  t  =  0, 1, . . ., 
then  [E:t+1]  also  holds. 

In  the  process  of  establishing  Proposition  8.2,  we  obtain  the  following 
characterization  of  the  limit  (37)  in  [E:t+1]:  For  arbitrary  mapping  g  :  IN  — ► 
Rp,  the  limiting  Rp+1-valued  rv  (L0(t  +  1  ),Lg(t  +  1))  admits  the  following 
decomposition 

(Lo(t  +  1),  Lg(t  +  1))  (40) 

=*  L0(t )  +  Aavg(t)) ,  L~gt(t)  -  f'(q(t))Rg(t)L0(t)  +  Ys(t  +  1)) 
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where  Rg(t)  is  the  element  in  Rp  introduced  at  (64)  (with  h  =  g )  and  the 
Rp- valued  rv  Yg(t  +  1)  is  a  zero-mean  Gaussian  rv  with  covariance  matrix 

2 »(<  +  1)  :=  E  {tj(W(t)yg(W(t))Z(t)(l  -  Z(t ))] .  (41) 

Moreover,  this  Gaussian  rv  is  independent  of  the  rvs  L0(t),  Lavg(t )  and  Lgt(t ), 
the  mappings  g  and  gt  being  defined  at  (47)  and  (48),  respectively. 

We  complete  the  proof  of  Theorem  4.1  by  an  easy  induction  argument: 
For  7  =  0,  [E:t]  trivially  holds  since  for  each  N  —  1,  2, . . .,  we  have  W;  (0)  = 
W  for  all  i  —  1, . . . ,  N  and  W{ 0)  =  W.  It  is  now  plain  from  Proposition  8.1 
and  Proposition  8.2  that  [E:t]  and  [F:t]  both  hold  for  all  t  =  0, 1, . . .,  and 
Theorem  4.1  is  established. 


9  A  proof  of  Proposition  8.1 

Pick  an  arbitrary  mapping  g  :  IN  — >  Rp  with  positive  integer  p.  Fix  t  — 
0, 1, . . .  and  N  =  1,  2, . . ..  We  begin  by  noting  that  under  [E:t],  the  map¬ 
ping  g  being  arbitrary ,  it  is  the  case  that  there  exists  an  Rp+2-valued  rv 
(Lo(t),  Lavg(t),  Lg(t))  such  that  the  joint  convergence 

vW^w.Li^.Lfy))  =► N  (42) 

takes  place.  Indeed  it  suffices  to  use  [E:t]  with  the  mapping  w  — >  (w,g(w)). 

As  we  seek  to  identify  Lo(t  +  1),  we  rewrite  the  limiting  recursion  (10)  in 
the  form 

q(t  +  1)  =  (q(t)  -C  +  B  [ll/(i)])+  =  (-K  (())+ 

with  K(t)  given  by  (14).  Combining  this  observation  with  the  queue  dynam¬ 
ics  (3)  gives 

=  max  (L«N>(i)  +  4  g  W,W(t)  ~  E  [»'(«)] . -  K(t)+ 
=  max  (L{0N)  (; t )  +  (; t ) ,K(t)^  -  K (t) + 
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so  that 


VNL{0N\t+  1)  (43) 

=  max  (VN  (4N\t)  +  ,  y/NK{t))  -  VNK(t)  +  . 

By  the  Continuous  Mapping  Theorem,  we  already  conclude  from  (42)  that 

VN  +  L^t))  Lo(t)  +  Lavg  (t).  (44) 

Three  cases  emerge  depending  on  the  sign  of  K(t).  If  K(t )  =  0,  then  (43) 
reduces  to 

vw4N\t+ 1)  =  (VN(c\t)+Li%(t))y 

and  the  convergence  (44)  yields 

VnLq^ (t  +  1)  =► N  (L0(t)  +  Tavg(t))  + 

again  by  the  Continuous  Mapping  Theorem. 

If  K(t)  <  0,  then  (43)  reduces  to 

VNL(0N\t  +  1)  =  max  (Vn  (l'"1)*)  +  L<"'(i))  . -^|*(t)|) 

and  the  convergence  (44)  yields 

VNLl  \t  +  1)  L0(t)  +  Lavg(t) 

since  \K(t)\  >  0  guarantees  linpv-^oo  VN\K(t)\  =  oo. 

Finally,  if  K(t)  >  0,  then  (43)  reduces  to 

VN. :LqJV)  (t  +  1)  =  max  (yN  (L^\t)  +  Lavg(t) W(t))  -  y/NK(t),  o) 

and  the  convergence  (44)  yields  y/N LqN'1  (t+1)  =>• n  0  since  linpv^oo  VN K (t) 
oo. 

It  follows  from  (42)  that 

VjV^r'W  +  ^W.if’W)  (Lo(«)  +  i,vg(i).i»W).  (45) 

and  the  hrst  part  of  the  proof  readily  leads  to  (38)  with  the  identification 
(39).  This  completes  the  proof  of  Proposition  8.1.  ■ 
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10  A  key  decomposition 

To  establish  Proposition  8.2,  we  start  with  an  arbitrary  mapping  g  :  IN  — ►  IP3 
for  some  positive  integer  p,  and  recall  the  definitions  (25)  and  (26)  of  the 
induced  mappings  g*,g *  :  IN  — >  Rp. 

Fix  N  —  1,  2, . . i  —  1, . . . ,  N  and  t  —  0, 1, . . ..  Making  use  of  (27)  and 
(11)  (in  a  similar  fashion),  we  get 

d(WiN\t  +  1))  -  E  [g(W(t  +  1))] 

=  Mf\t  +  l)9*(wf°(f))  +  (1  -  Mf\t  +  l))g„(wf°(t)) 

-E  [M(t  +  l)g*(W(t))  +  (1  -  M(t  +  l))a.(W’(t))] 

=  9,(wf>))"E[9,(iy(«))] 

+  (g*(wf  >(<))  -  9,(wf°M))  +  1) 

~E  [(g*(lE(f))  -  g,(W(t)))  M(t  +  1)] .  (46) 

With  the  mapping  g  :  IN  — >  Rp  dehned  by 

g(w)  =  g*(w )  -  c/*(w),  w  G  IN  (47) 

we  obtain  the  decomposition 

g(wP\t  +  1))  -  E  [9(lV(i  +  1))] 

=  g,(irj('T|W)-E[g,(ir(())] 

+  9(W,i<W>W)(vf)(i  +  l)-Zf)(«)) 

+  m,,N>(t))-r(t)W’<“l<,>  -  E  \g(W(t))Z(t) } 


as  we  note  that 


E  l(g*(ir  (t))  -  g,(W(t)))  M(t  +  1)]  =  E  [g(W(t))Z(t) } 


since,  in  analogy  with  (28),  we  also  have 


E 


M(t  +  1) 


Tt 


Z(t)  a.s. 


by  virtue  of  (12),  (23)  and  (24). 
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Finally,  defining  the  mapping  gt  :  IN  — >  1RP  by 

9t{w)  :=  g*{w)  +g{w)  ■  we  IN  (48) 

we  find 

9(tbW)(t+l))-E[9Wt+l))] 

=  9.(Wi<W)(<))-E(9t(»r(t))] 

+  g(w,m '(«))  (m<n) \t  +  1)  -  Z[N)  (S)) 

+  mfHm  (z,(N>(t)  -  7  (i)",;"><0)  ■  (49) 

This  decomposition  forms  the  basis  for  the  forthcoming  analysis.  The  sub¬ 
sequent  sections  discuss  the  needed  asymptotics  for  each  of  the  three  terms 
of  (49). 

11  A  conditional  CLT 

The  second  term  of  (49)  gives  rise  to  a  conditional  CLT  which  we  now  develop: 
For  any  mapping  h  :  IN  — 4  IP  with  positive  integer  q,  we  set 

1  N 

YlN\t  +  1 )  :=  ^  E  W(A°W)  +  !)  -  ,  N  =  1,2,... 

i= 1 

for  each  t  =  0, 1, . . ..  We  begin  with  the  case  q  =  1. 

Proposition  11.1.  Assume  (Alb)-(A2)  to  hold  and  consider  an  arbitrary 
mapping  h  :  IN  — »  R.  Then,  for  each  t  =  0, 1, . . .,  it  holds  that 

E  exp  (jeVNY^N)(t  +  1))  Tt  ~^n  e~^t+1) ,  9  e  R  (50) 

with 

<Jh(t+  1)  :=  E  [h(W(t))2Z(t)(  1  -  Z(t))]  .  (51) 

The  proof  of  Proposition  11.1  is  given  in  Appendix  C.  By  using  the 
standard  Cramer- Wold  device  [3,  Thm.  7.7,  p.  49]  we  obtain  the  following 
analog  in  higher  dimensions: 
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Corollary  11.2.  Assume  (Alb)-(A2)  to  hold  and  consider  an  arbitrary  map¬ 
ping  h  :  IN  — >  EC  for  some  positive  integer  q.  Then,  for  each  t  =  0, 1, . . .,  it 
holds  that 

E  exp(jVNYiN\t+l)6'^  Tt  -^N  e-^e^t+1)d\  OeW  (52) 
with  q  x  q  covariance  matrix  £/j(f  +  1)  given  by 

Eh(t  +  1)  :=E[h(W(t))'h(W(t))Z(t){l-Z(t))}.  (53) 


We  conclude  with  the  following  crucial  by-products:  For  some  t  —  0, 1, . .  *, 
and  an  arbitrary  positive  integer  r,  consider  the  situation  where  a  sequence 
of  Hr- valued  rvs  {A ^(t),  N  =  1,  2, . . .}  weakly  converges,  say 

A{N\t)^NA(t)  (54) 

for  some  limiting  Ih'-valued  rv  A (t).  If  for  each  iV  =  1,2,..,,  the  rv  A (N\t) 
is  .^-measurable,  then  Corollary  11.2  readily  implies  [3,  Thm.  3.2,  p.  21] 
the  joint  convergence 

{VNY£N\t  +  l),AW(t))  ==t>N  (Yh{t+l),A{t))  (55) 

for  some  zero-mean  Gaussian  rv  Yh(t,  +  1)  with  covariance  matrix  E^ (t  +  1), 
where  the  rv  Yh(t+ 1)  is  taken  to  be  independent  of  the  rv  A (t).  In  particular, 
this  applies  to  the  mapping  h  —  g  appearing  in  the  second  term  of  (49). 

12  The  Delta  Method 

The  contributions  of  the  last  term  in  the  decomposition  (49)  are  handled  by 
the  Delta  Method  [20,  Thm.  3.1,  p.  26].  While  this  result  is  often  associated 
with  the  Central  Limit  Theorem,  we  now  state  the  version  to  be  used  here. 

Proposition  12.1.  Let  f  :  R+  — >  [0,1]  be  a  differentiable  mapping  with 
derivative  f  :  Et+  — >  It  continuous  at  x  =  q{t).  If  for  some  t  =  0,1,...,  the 
convergence 
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takes  place  with  some  rv  Lq  (t) ,  then 


mm*®. 


(57) 


We  do  not  require  a  priori  that  the  limit  in  (56)  be  normally  distributed. 
Although  the  result  is  well  known,  a  proof  is  nevertheless  provided  below  in 
order  to  validate  several  joint  convergence  statements  which  turn  out  to  be 
crucial  for  proving  Proposition  8.2. 


Proof. 

that 


Fix  t  =  0,1,...  and  N  =  1,  2, . . ..  We  start  with  the  observation 

vw  (/(521W)  - /wo)) 

VN  J  (f'(x)  -  f(q(t)))dx  +  VN  ^ — — - q(t)Jf{q(t)) 

VNU^N\t)  +  VN ))  (58) 


where  we  have  set 

QW(t) 

U(N\t )  :  =  /  (f(x)  -  f\q{t)))dx. 

Jg{t) 

The  desired  conclusion  (57)  will  readily  follow  if  we  show  the  convergence 


VNUfN>(t)  — — > jv  0. 


(59) 


To  that  end,  fix  e  >  0  arbitrary.  For  any  5  >  0,  we  have 


VN\U{N\t)\  >  £ 


<  P 


VN\U{N\t)\  >  e, 

QW(t) 


Q{N)  (t) 


N 


-q(t) 


<  6 


N 


-q(t) 


>  6 


(60) 


By  the  continuity  of  f  at  x  —  q(t ),  for  each  rj  >  0,  there  exists  5(rj)  >  0  such 
that  | f'{x)  —  f'(q(t)) |  <  rj  whenever  \x  —  q(t)\  <  5(rj)  in  R+.  Now  fix  rj  >  0 


22 


and  pick  <5  >  0  in  the  range  (0,  S(q)).  Thus,  on  the  event  [  Q(  —  q(t)  <  5], 
we  find  that 

VN\U{N\t)  \  <  VNri  _  q(t) 

Reporting  this  fact  into  the  inequality  (60)  we  obtain 

p  k/iv|[/(7V)(t)|  >  e 

<  P  >(  +P  >5  (61) 

Letting  N  go  to  infinity  in  (61)  and  using  the  convergence  (7)  and  (56),  we 
get 

lim sup  P  \VN\U^(t)\  >  e]  <  P  L0(t)>-  .  (62) 

V— >oo  L  J  L  V. 

The  desired  conclusion  (59)  is  now  immediate  upon  letting  77  >  0  go  to  zero 
in  this  last  inequality  since  its  left-hand  side  is  independent  of  77.  ■ 


13  Using  the  Delta  Method 

For  any  mapping  h  :  IN  — >  IP  with  positive  integer  q,  set 
1  N 

xlN)(t)  :=  L  Y1  ft(W'-|JV)(0)  (7<A'l(*)"-"><,)  -  ,  N  =  1,2, . . . 

i= 1 

for  each  t  =  0, 1, . . ..  The  relevant  limiting  result  is  presented  next. 

Proposition  13.1.  Assume  (Alb)-(A2)  to  hold  and  consider  an  arbitrary 
mapping  h  :  IN  — >  IP  for  some  positive  integer  q.  If  for  some  t  =  0,1,..., 
the  convergence  (56)  holds  with  some  rv  L0(t),  then  it  holds  that 

VNX{hN\t)  =r>  N - f{q{t))Rh{t)L0{t )  (63) 

with 

Rh(t)  :=  E  \w(t)  (1  -  .  (64) 
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Proof.  Fix  N  —  1,  2, . . .  and  i  =  1, . . . ,  N.  From  (24)  and  (30),  we  observe 
that 


7W(t)w™W  -7{t)w<w® 

=  ~WlN\t)  f  "  (1  -y)wnt)-l  dy 

=  -wrmi f»(0 

-  w^(t)  (f  -  /(«(*)))  (1  -  (65) 


where  we  have  set 


A f\t)  := 

Consequently, 


/(^) 


/(?(*)) 


(1  -  -  (1  -  /(4(«)))W‘">(,,-11 


V 


i  £  wwTW))  ■  VF  (/  (27U )  -  /(,(«)) 


(66) 


i=  1 


where  the  mapping  h*  :  IN  — >  Rp  is  dehned  by 

K (w)  :=  wh(w)  (1  -  /(<?(t))r-1 ,  w  e  IN. 
Using  the  inequality  (B.7),  we  find  that 


IaTWI  <  (wf’M-i) 

rf^) 

/  |j/-/(e(<))l  dy 

\  / 

< 


Wn 


U(^) 


'/(«(*)) 


Is/ ^ /(?(*))!  dy 


(67) 
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Thus, 


< 


Vn 

wma 


N 


N 


i=  1 


-Vn 


/  (VV)  - im)  ( ^h\^N)mwrV 


1 2  /  _  AT 

N 


i= 1 


Let  IV  go  to  infinity.  Combining  the  convergence  (13)  with  Proposition  12.1 
already  yields 

QW)-mV 


Vn 


f 


>N 


0. 


N  ) 

It  now  follows  by  Claim  (ii)  of  Theorem  3.1  (applied  to  the  mapping  w 
xc? || /i(xf)  || )  that 


Vn 


N 


i= 1 


>N 


o. 


(68) 


Therefore,  in  view  of  the  decomposition  (66)  and  of  the  convergence  (68), 
the  convergence  (63)  will  hold  provided  we  can  show 

^  (f  (W)  ~  f(q(t>>)  =*•«  f(q(t))Rh(t)L„(t). 

This  convergence  follows  from  Proposition  12.1  once  we  note  that 


N 


N 


>N 


Rh(t ) 


i=l 


by  Claim  (ii)  of  Theorem  3.1  (applied  to  the  mapping  h*). 


A  careful  inspection  of  the  proofs  of  Propositions  12.1  and  13.1  reveals 
that  a  somewhat  stronger  statement  is  true:  For  some  t  —  0, 1, . . . ,  consider 
the  situation  where  a  sequence  of  Rr -valued  rvs  (A(iV^(t),  N  =  1,2,...} 
is  weakly  convergent  as  in  (54)  together  with  (56),  i.e.,  we  have  the  joint 
convergence 

(VNL^\t),  A(iV)(t))  (L0(*),A(t))  .  (69) 
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for  some  limiting  Revalued  rv  A(f).  Then,  the  convergence  (63)  can  be 
extended  to  read 

(V7VA'f'(«),A .<">(<))  ^-f'(q(t))R„(t)L0(t)tA(tj  .  (70) 

14  A  proof  of  Proposition  8.2 

Pick  an  arbitrary  mapping  g  :  IN  — >  Rp  with  positive  integer  p.  Fix  t  = 
0, 1, . . .  and  N  =  1,2, . . and  go  back  to  the  basic  decomposition  (49):  With 
the  notation  introduced  earlier,  we  note  that 

Lf\t  +  1)  =  Lft\t)  +  Xf\t)  +  Ys(N\t  +  1)  (71) 

where  g  and  gt  are  the  mappings  IN  — >  Rp  defined  earlier  at  (47)  and  (48). 
Also  recall  (43)  from  the  proof  of  Proposition  8.1  to  the  effect  that 

VNL^\t+  1)  (72) 

=  max  (VN  (Lf\t)  +  Lgg(t))  ,  y/NK{tj)  -  VNK(t)+. 

By  Corollary  11.2,  we  already  have 

VNY-{N\t  +  1)  =/■  jy  Yfj(t  +  1)  (73) 

for  some  zero-mean  Gaussian  rv  Yfj{t  +  1)  with  covariance  matrix  E ^(t  +  1) 
given  by  (53)  (with  h  —  g).  However,  the  rvs  L^\t),  L(^\t)  and  X~N\t) 
are  each  jFt- measurable  for  each  N  =  1,2,....  Therefore,  having  in  mind  the 
comments  following  Corollary  11.2,  we  introduce  the  R2p+2-valued  rv  MN\t) 
defined  by 

A (N\t)  :=Viv(C(4lSrl(l)1Af)(l)) 

where  the  mapping  gt  :  IN  — >  Rp+1  is  given  by 

gt{w)  :=  (w,gt(w)),  w  e  IN. 

We  will  have  established  the  convergence  part  of  Proposition  8.2  if  we 
can  show  the  joint  convergence 

A(N)(f)  ——^n  A (t)  :=  (L„(f), £,,((), X5(f))  (74) 
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for  some  R2p+2- valued  rv  (L0(t),  Lgt(t),  Xg(t))  to  be  determined.  Indeed,  as 
indicated  at  the  end  of  Section  11,  this  would  readily  imply 

(A^y),  vivify* +i))  =>w(Am,n(<+i))  (76) 

with  the  Gaussian  rv  Yg{t  +  1)  being  taken  independently  of  A (f),  and  the 
conclusion 

y/N  (L^\t  +  1),  Lf  \t  +  1))  (. L0{t  +  1),  Lg{t  +  1))  (76) 

is  now  straightforward  by  applying  the  Continuous  Mapping  Theorem  on  the 
relations  (72)  and  (71).' 4 

We  need  only  identify  the  limiting  rv  in  (74)  and  (76):  Under  [E:t],  it  is 
already  the  case  that 

V/VUrW.iW)*))  (!„(«), !„(*)).  (77) 

Next,  with 

A<iV)«  =  VN(Li,N\t),Lm(t)), 

the  strengthening  (69)-(70)  of  Proposition  13.1  leads  to  (70)  in  the  form 

(A {N\t):VNXlN\t)^  ^ N  (L0(t),Lgt(t),-f(q(t))Rg(t)L0(t)).  (78) 

In  other  words,  joint  convergence  (74)  takes  place  with  the  limiting  rv  iden¬ 
tified.  ■ 
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Appendices 

A  A  proof  of  Lemmas  7.1— 7.4 
A.l  A  proof  of  Lemma  7.1 

Together,  the  convergence  statements  [A:t]  and  [B:t]  imply  the  joint  con¬ 
vergence  (N~1Q('N\t),WiN\t))  =^v  (q(t),W(t))  [9,  Thm.  5.28,  p.  150]. 

Next  the  continuity  of  the  mapping  /  implies  that  of  the  mapping  (x,  w)  — » 

(1  —  f(x))w  on  R+  x  (0,  oo),  so  that 

H'fy*))  ( Z(t ),  W(t))  (A.l) 
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by  the  Continuous  Mapping  Theorem  [9,  Thm.  5.29,  p.  150]  with  Z(t) 
defined  at  (23). 

Consider  (33)  for  an  arbitrary  mapping  g  :  IN  — >  R,  and  observe  that 
the  mapping  Fg  dehned  by  (32)  is  bounded  and  continuous  on  [0, 1]  x  IN.5 
Consequently,  the  Continuous  Mapping  Theorem  can  again  be  invoked  to 
yield 

»'<">(«))  =$■  n  F,(Z(t ),  W(t)),  (A. 2) 

whence 

Urn  E  k(Zy»(t),  Wf°M)l  =  E  \F,(Z(t),  W(t ))]  (A.3) 

A'— >oo  L  J 

by  the  Bounded  Convergence  Theorem  [9,  Thm.  4.16,  p.  108].  Combining 
(33)  and  (A.3)  we  get 

lim  E  \g(W[N\t  +  1))1  =  E  [Fg(Z(t),  W(t ))] . 

N—>  oo  L 

On  the  other  hand,  the  rvs  W{t)  and  V{t  +  1)  are  independent,  and 
inspection  of  the  dynamics  (11)  and  (12)  reveals  that 

E  [g(W(t  +  1))]  =  E  [F„(Z(t),  W(t))\ .  (A.4) 

The  mapping  g  being  arbitrary,  it  follows  immediately  that  w[N\t  +  1)  =^jv 
W(t+  1)  for  some  {1, . . . ,  !'Tmax}-vahied  rv  W(t  +  1)  dehned  through  (11) 
and  (12).  ■ 

A. 2  A  proof  of  Lemma  7.2 

Fix  N  —  1,  2, . . ..  From  [A:t]  and  [D:t]  (with  g(x)  =  x),  we  conclude  that 

-  c  +  1  jr  W,(N\t )  ——*n  q(t)  -C  +  E  [W(t)\ 

1=1 

and  the  continuity  of  the  function  x  — »  x+  implies  the  convergence 

Av  9(i+l) 

5This  continuity  is  with  respect  to  the  product  topology  on  [0, 1]  x  IN  where  IN  is 
topologizecl  according  to  the  usual  discrete  topology. 
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with  non-random  q(t  +  1)  since 


V  i.  i 

The  dynamics  (10)  giving  q(t  +  1)  is  immediate.  ■ 


A. 3  A  proof  of  Lemma  7.3 

Fix  a  positive  integer  I.  The  rvs  V\ (t  +  1), , . . ,  Vj{t  +  1)  are  i.i.d.  [0, 1]- 
uniform  rvs  which  are  independent  of  Tt-  Thus,  upon  making  use  of  (5),  we 
see  that  the  rvs  W[N\t  +  1), . . . ,  WjN\t  + 1)  are  mutually  independent  given 
Tt.  Consequently,  for  arbitrary  mappings  gi, . . .  ,gj  :  IN  — >  R,  we  get 

"  1  I  / 

e  =  nE[«wl">(*+i))|^ 

_i= 1  _  i= 1 

i= 1 

with  the  help  of  (31)  and  (32). 

Now  it  follows  from  (9)  in  [C:t]  that  the  joint  convergence 

(wlN\t), ....  (»',(«), ....  W,(t)) 

holds  with  limiting  rvs  Wi(t), . . . ,  Wj{t)  which  are  i.i.d.  rvs,  each  distributed 
according  to  W{t).  As  in  the  proof  of  Lemma  7.1,  the  arguments  leading  to 
the  convergence  (A. 2)  also  lead  to 

Wf°(t)), ....  \t),  W,tN>m 

(Fgi(Zi(t),  WI(t)), ....  F„(Z,(t),  W,(t))) 

where  the  limiting  rvs  (Zi(t),  W\{t) ),...,  Wi  (t))  are  i.i.d.  rvs  each 

distributed  according  to  the  pair  (Z(t),  W(t)).  Therefore,  by  the  Bounded 
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Convergence  Theorem, 

~  i  I  r  / 

lim  E  n»W<N)(*+l))  =  Hm  E 

iV— xx  A  A— xx  A  ■*- 

_i= 1  J  li=l 

"  I 

=  E  YiFMwm 

_i— 1 
I 

=  nEi 

1=1 
I 

=  nw(‘+D)]  (a.5) 

1=1 

where  the  last  equality  made  use  of  the  relation  (A. 4).  The  desired  result 
[C:t+1]  now  follows  from  (A.5)  given  that  the  mappings  g\, . . .  ,gj  are  arbi¬ 
trary.  ■ 


A. 4  A  proof  of  Lemma  7.4 

Pick  a  mapping  g  :  IN  — >  1R.  We  begin  by  observing  that  under  (A2)  the  rvs 
W^N\t), . . . ,  are  exchangeable.  As  a  result,  we  get 

"  I  N 

var 

i= 1 

N  N 

=  N-2^2var[g(wj;N\t))]  +  N~2  ^  co v[g(Wtm (t)),  g(W^N\t))} 

i=l  ij=l7i^j 

=  A^"1var[c/(W1(JV)(t))]  +  N  N  1  cov  \g{w[N)  ( t)),g  ( W$N)  (t ) )] . 

Let  N  go  to  infinity  in  this  last  relation.  The  validity  of  [C:t]  and  the 
Bounded  Convergence  Theorem  already  imply 

lim  cov[g(wlN) (t)),  g(W^N) {t))]  =  cov[g(W1(t)),g(W2(t))}  =  0 

A— XX 

by  asymptotic  independence.  On  the  other  hand,  |fi,(W/^JV\f))|  <  G  where 
G  :=  max{|^(x)|,  x  =  1, . . . ,  Wm™}  so  that  lim  sup^^^  var[(yf(hL1^JV\t))]  < 
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G2.  Combining  these  observations,  we  readily  see  that 


whence 


N 


lim  var 

TV— XX) 


Estw'f'b))  -  e 


N 


i=l 


=  0, 


N 


i=  1 


TV 


JV 


1=1 


by  Chebyshev’s  Inequality.  This  last  convergence  is  equivalent  to 


N 


I>(W0))-E  g(w[N\t)) 


N 


1=1 


r(N), 


by  exchangeability,  and  the  desired  convergence  result  (8)  is  now  immediate 
once  we  remark  under  [B:t]  that  lim^E  =  E[g(W(t)}.  U 


B  A  proof  of  Proposition  7.5 

Fix  t  —  0, 1, . . .  and  £=1,2,....  Also  fix  N  =  1,  2, . . .  and  i  =  1, . . . ,  N .  We 
have 

=  f (i  -  /  ,<‘)  _  (1  _  fm)rrm 

+»wWWW)  (B.6) 

with  mapping  gt^  :  R  — >  1R  given  by 

:=^(w)(l-/(g(t))/u',  w  G  IN. 

Next,  for  any  pair  a,  b  in  [0, 1],  we  have 


| ap  -  bv\  =  p 


tp  dt 


<  p\b  —  o| 


(B.7) 
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for  each  p  —  1,  2, . . so  that 


V  N  ) 


<  tw[N)(t) 


Therefore, 


i  N 

-nmr-  {,) 


i=  1 


< 


JV 


£wf°(f)  9(^<w)w) 


IV 


i=l 


and  from  the  convergence  (13),  we  get 


N 


N 

E  jfw7, W)  (zf ’(()'- (1-/(9 W))"'"’®)  -%0  (B.8) 

1=1 


since 

i  w 

-£wf')(«)|j(M'fV))|  ~^N  E  [W(t)\g(W(t))\] 

i= 1 

by  Claim  (ii)  of  Theorem  3.1. 

The  conclusion  is  now  immediate  from  the  decomposition  (B.6),  the  con¬ 
vergence  (B.8)  and  the  convergence 

1  N 

~~>N  EMW«)1 

i= 1 

obtained  from  Claim  (ii)  of  Theorem  3.1.  ■ 


C  A  proof  of  Proposition  11.1 

We  rely  on  the  following  two  technical  lemmas;  their  proofs  are  omitted  in 
the  interest  of  brevity. 
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Lemma  C.l.  For  any  x  in  R,  the  Taylor  series  expansion 

2 

ejx  —  1  +  jx  —  S-  +  R(x)  (C.9) 

holds,  with  complex-valued  remainder  term  R(x)  satisfying 

|J?(x)|  <  (C.10) 

Lemma  C.2.  Consider  the  array  of  complex-valued  rvs  { C i  —  1,  ■  ■  ■ ,  N;  N  = 
1,2,.. .}  with  |(7jv,i|  <  1  for  i  =  1, . . . ,  N.  If  maxj=ir..!jv  |Cjv,i|  — > ►at  0  a.s.  and 

Sill  CW,i  -^jv  A,  then 

N 

J^[(l  —  Cn,i)  —>n  e~x.  (C.ll) 

i=l 

The  proof  of  Proposition  11.1  can  now  proceed:  Fix  iV  =  1,  2, . . .  and  9 
arbitrary  in  R.  By  conditional  independence  and  making  use  of  (28),  we  find 
that 

E  |exp  (jeVNYiN\t  + 1))  |^t] 

=  l[i  .  (m! ,N,(t  +  i)  - z, '"’(*))))  \r, 

N 

=  nO-c^W)  (c.12) 

i= 1 

with 

y’WKi-zb’W))]  (c.  13) 

.  9 

J7^ 

for  each  i  —  1, . . . ,  N. 


h(w!>N\t))z\N\t )) 


Cf\t)  =  Z\N\t)  1  —  exp  (  j—=h{\ 


+  (1  -Z\N){t))  1-exp 
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In  view  of  these  remarks,  the  desired  result  (50)  is  now  a  simple  conse¬ 
quence  of  Lemma  C.2  provided  the  required  conditions  can  be  shown  to  hold, 
namely 

lim  max  \ClN\t)\  =  0  a.s. 


iV— >oo  i=l,...,N 


and 


N 


JUN  u-ah(t  +  l) 


e2 


(C.14) 

(C.15) 


1=1 


with  a h{t  +  1)  given  by  (51). 

To  check  these  conditions,  we  first  invoke  Lemma  C.l  to  write 


ciN)(t)  =  zrm%>(t)  +  (i  -  zr(t))B$>(t) 


'(N)  /  ,\  d(JV) 


(N), 


AN), 


(C.16) 


with 


+  '(0)^(1  -  zr\t)f + wit, o)  (c.i7) 


AN) 


(N)(, 


and 


2  N 


B%\t)  =  j  At=h(w)N\t))z\N\t) 


e1 


+  5T7  KWlN\t)fz[N\t)2  +  0)  (C.18) 


2N 


where  the  remainder  terms  fi\hp  {t:  6)  and  /3^\t]  6)  in  these  expressions  sat¬ 
isfy 

max  ( }  (t ;  0)  | ,  | (t;  6^  ^  ^ 


<K-  . _ 

6VN* 

for  some  positive  constant  K,  say  K  :=  max{|h(w)|3,  w  —  1, . . . ,  lLma.T}. 

Thus,  condition  (C.14)  trivially  holds.  To  establish  (C.15),  report  (C.17) 
and  (C.18)  into  (C.16).  Simplifying  the  resulting  expression,  we  find 

Cf'(i)  =  ^h(wlN\t)fz\N\t)(l-Z[N\t))+1\N\t0)  (C.19) 


with  remainder  term 

AN)t+.a\  -  r(N)f,,„(N) 


1 P'M)  :=  zr'WC'(«;«)  +  (1  -  ((;«). 
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Obviously, 


(C.20) 


Next,  we  write 

N  f  -i  N  \ 

E  cf°(*)  =  J  ^  E  h{wlN\t)fz\N\t){  1  -  zf\t))  +  r(7V)(t) 

i=l  \JV  i=l  / 

where  we  have  set 

1  N 

r,N,w 

i=l 

By  repeated  application  of  Proposition  7.5  (with  £  =  1  and  £  =  2)  we  get 

£  h(wlN\t)Yz\N)m  -  zf >(«))  <7»(s  + 1) 

i= 1 

with  crh(t  +  1)  given  by  (51),  while  liniiv-»oor^(i)  =  0  a.s.  by  virtue  of 
(C.20).  The  desired  conclusion  (C.15)  is  obtained  and  the  proof  of  Proposi¬ 
tion  11.1  is  complete.  ■ 
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